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©Automated Recognition of 3D Features in GPIR Images 

Enhanced images emphasizing features of interest are prepared for scrutiny by human analysts. 

NASA’s Jet Propulsion Laboratory, Pasadena, California 



Features Representing Two Pipes were generated by applying a feature-extraction algorithm to data 
from a GPIR scan of 110th Street in New York City. This synthetic image contains the detection marks 
overlaid on GPIR data from a mid-depth horizontal slice viewed from overhead. The gaps and undula- 
tions are minimized in subsequent processing by a multiaxis data-fusion/pattern-recognition algorithm. 


A method of automated recognition 
of three-dimensional (3D) features in 
images generated by ground-penetrat- 
ing imaging radar (GPIR) is undergoing 
development. GPIR 3D images can be 
analyzed to detect and identify such sub- 
surface features as pipes and other util- 
ity conduits. Until now, much of the 
analysis of GPIR images has been per- 
formed manually by expert operators 
who must visually identify and track each 
feature. The present method is intended 
to satisfy a need for more efficient and 
accurate analysis by means of algorithms 
that can automatically identify and track 
subsurface features, with minimal super- 
vision by human operators. 

In this method, data from multiple 
sources (for example, data on different 
features extracted by different algo- 
rithms) are fused together for identify- 
ing subsurface objects. The algorithms 
of this method can be classified in sev- 
eral different ways. In one classification, 
the algorithms fall into three classes: (1) 
image-processing algorithms, (2) fea- 
ture-extraction algorithms, and (3) a 
multiaxis data-fusion/pattern-recogni- 
tion algorithm that includes a combina- 
tion of machine-learning, pattern-recog- 
nition, and object-linking algorithms. 

The image-processing class includes 
preprocessing algorithms for reducing 


noise and enhancing target features for 
pattern recognition. The feature-extrac- 
tion algorithms operate on preprocessed 
data to extract such specific features in 
images as two-dimensional (2D) slices of 
a pipe. Then the multiaxis data- 
fusion/pattern-recognition algorithm 
identifies, classifies, and reconstructs 3D 
objects from the extracted features. In 
this process, multiple 2D features ex- 
tracted by use of different algorithms and 
representing views along different direc- 
tions are used to identify and reconstruct 
3D objects. In object linking, which is an 
essential part of this process, features 
identified in successive 2D slices and lo- 
cated within a threshold radius of identi- 
cal features in adjacent slices are linked 
in a directed-graph data structure. Rela- 
tive to past approaches, this multiaxis ap- 
proach offers the advantages of more re- 


liable detections, better discrimination of 
objects, and provision of redundant in- 
formation, which can be helpful in filling 
gaps in feature recognition by one of the 
component algorithms. 

The image-processing class also includes 
postprocessing algorithms that enhance 
identified features to prepare them for fur- 
ther scrutiny by human analysts (see fig- 
ure) . Enhancement of images as a postpro- 
cessing step is a significant departure from 
traditional practice, in which enhance- 
ment of images is a preprocessing step. 

This work was done by Han Park, Timothy 
Stough, and Amir Fijany of Caltech for 
NASA’s fet Propulsion Laboratory. 

The software used in this innovation is 
available for commercial licensing. Please 
contact Karina Edmonds of the California 
Institute of Technology at (626) 395-2322. 
Refer to NPO-40698. 


©Algorithm Plans Collision-Free Path for Robotic Manipulator 

This algorithm is designed to make minimal demands upon computational resources. 

NASA’s Jet Propulsion Laboratory, Pasadena, California 


An algorithm has been developed to 
enable a computer aboard a robot to au- 
tonomously plan the path of the manipu- 
lator arm of the robot to avoid collisions 
between the arm and any obstacle, which 
could be another part of the robot or an 
external object in the vicinity of the 
robot. In simplified terms, the algorithm 
generates trial path segments and tests 
each segment for potential collisions in 
an iterative process that ends when a se- 


quence of collision-free segments reaches 
from the starting point to the destination. 
The main advantage of this algorithm, 
relative to prior such algorithms, is com- 
putational efficiency: the algorithm is de- 
signed to make minimal demands upon 
the limited computational resources 
available aboard a robot. 

This path-planning algorithm utilizes a 
modified version of the collision-detec- 
tion method described in “Improved 


Collision-Detection Method for Robotic 
Manipulator” (NPO-30356), NASA Tech 
Briefs, Vol. 27, No. 3 (June 2003), page 
72. The method involves utilization of 
mathematical models of the robot con- 
structed prior to operation and similar 
models of external objects constructed 
automatically from sensory data acquired 
during operation. This method incorpo- 
rates a previously developed method, 
known in the art as the method of ori- 
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ented bounding boxes (OBBs) , in which 
an object is represented approximately, 
for computational purposes, by a box 
that encloses its outer boundary. Because 
many parts of a robotic manipulator are 
cylindrical, the OBB method has been 
extended in this method to enable the 
approximate representation of cylindri- 
cal parts by use of octagonal or other 
multiple-OBB assemblies denoted ori- 
ented bounding prisms (OBPs) . 

A multiresolution OBB/OBP repre- 
sentation of the robot and its manipula- 
tor arm and a multiresolution OBB rep- 
resentation of external objects 
(including terrain) are constructed and 
used in a process in which collisions at 
successively finer resolutions are de- 
tected through computational detection 
of overlaps between the corresponding 
OBB and OBP models. For computa- 
tional efficiency, the process is started at 
the coarsest resolution and stopped as 
soon as possible, preferably before 
reaching the finest resolution. At the 
coarsest resolution, there is a single OBB 
enclosing all relevant external objects 
and a single OBB enclosing the entire 
robot. At the next finer level of resolu- 
tion, the coarsest-resolution OBB is di- 
vided into two OBBs, and so forth. If no 
collision is detected at the coarsest reso- 
lution, then there is no need for further 
computation to detect collisions. If a col- 
lision is detected at the coarsest resolu- 
tion, then tests for collisions are per- 
formed at the next finer level of 
resolution. This process is continued to 
successively finer resolutions until either 
no more collisions are detected or the 


finest resolution is reached. 

The path-planning algorithm oper- 
ates on a representation of the robot 
arm and obstacles in a Cartesian coor- 
dinate system. The figure schematically 
depicts a simplified example of the 
geometric effects of the algorithm. In 
this example, the robot arm has been 
commanded to move from a starting 
point to a destination. The problem to 
be solved by the algorithm is to choose 
waypoints (Wj , W 2 , ...) and straight-line 
path segments connecting the way- 
points (including the starting point 
and destination as waypoints) so that 
there is no collision along any segment. 
The algorithm can be summarized as 
follows: 

1. Generate a straight-line path (s 3 ) 
from the starting point (W 3 ) to the 
destination. 

2. Using the collision-detection method 
described above, test for collisions 
along this path. 

3. If there is a collision (denoted by col- 
lision point c, ) , then by use of a geom- 
etry-based subalgorithm too complex 
to be described within the space avail- 
able for this article, generate two new 
sub-paths (s 2 and s 3 ) that connect a 
new waypoint (W 2 ) with the ends of s,. 

4. Test each new sub-path for collisions. 

5. If a collision is detected on either sub- 
path (e.g., at collision point c 2 on s 2 ), 
then in the manner of step 3, generate 
new sub-sub paths (s 21 and s 22 ) that con- 
nect new way point W 3 with W t and W 2 . 

6. Test for collisions and generate new 
path segments in the manner de- 
scribed above until the starting and 



A Multi-Segment Path is generated in an itera- 
tive process of generating candidate segments 
and testing them for collisions. 


destination points are connected by 
collision-free path segments. In this ex- 
ample, the result is a total of seven way- 
points connected by six path segments. 
This work was done by Paul Backes and 
Antonio Diaz-Calderon of Caltech for NASA’s 
fet Propulsion Laboratory. 

The software used in this innovation is 
available for commercial licensing. Please 
contact Karina Edmonds of the California 
Institute of Technology at (626) 395-2322. 
Refer to NPO-41 697 


©Hybrid Automated Diagnosis of Discrete/ Continuous Systems 

Integration of complementary tools offers new approach to hybrid diagnosis. 

NASA’s Jet Propulsion Laboratory, Pasadena, California 


A recently conceived method of auto- 
mated diagnosis of a complex electro- 
mechanical system affords a complete 
set of capabilities for hybrid diagnosis in 
the case in which the state of the electro- 
mechanical system is characterized by 
both continuous and discrete values (as 
represented by analog and digital sig- 
nals, respectively) . The method is an in- 
tegration of two complementary diag- 
nostic systems: (1) beacon-based 

exception analysis for multimissions 
(BEAM) , which is primarily useful in the 
continuous domain and easily performs 
diagnoses in the presence of transients; 


and (2) Livingstone, which is primarily 
useful in the discrete domain and is typ- 
ically restricted to quasi-steady condi- 
tions. BEAM has been described in sev- 
eral prior NASA Tech Briefs articles: 
“Software for Autonomous Diagnosis of 
Complex Systems” (NPO-20803), Vol. 
26, No. 3 (March 2002), page 33; “Bea- 
con-Based Exception Analysis for Multi- 
missions” (NPO-20827), Vol. 26, No. 9 
(September 2002), page 32; “Wavelet- 
Based Real-Time Diagnosis of Complex 
Systems” (NPO-20830), Vol. 27, No. 1 
(January 2003), page 67; and “Inte- 
grated Formulation of Beacon-Based Ex- 


ception Analysis for Multimissions” 
(NPO-21126), Vol. 27, No. 3 (March 
2003), page 74. 

Briefly, BEAM is a complete data- 
analysis method, implemented in soft- 
ware, for real-time or off-line detection 
and characterization of faults. The basic 
premise of BEAM is to characterize a sys- 
tem from all available observations and 
train the characterization with respect to 
normal phases of operation. The obser- 
vations are primarily continuous in na- 
ture. BEAM isolates anomalies by analyz- 
ing the deviations from nominal for 
each phase of operation. Livingstone is a 
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